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Abstract 

We consider a Markov chain obtained by random iterations of Lipschitz 
maps Ti chosen with a probability pt(x) depending on the current position 
x. We assume this system has a property of "contraction on average" , that 
is 

^2d(TiX,Tiy)pi(x) < pd(x,y) 

i 

for some p < 1. In the present note, we study the weak convergence of 
the empirical process associated to this Markov chain. 
Keywords: Markov chain; Empirical processes; Weak convergence. 

1 Introduction 

The study of limit behavior of partial sums of random variables has a long time 
interest in dynamical systems or Markov chains theory. Existence of (attrac- 
tive) invariant measure, law of large numbers, central limit theorem, almost 
sure invariance principle are results that characterize the statistical properties 
of such systems. In this note, we study the limit behavior of empirical processes, 
associated to some random iterative Lipschitz models. The analyze of empir- 
ical processes convergence is also of interest in dynamical systems in order to 
derive statistical tests, as Kolmogorov-Smirnov test. See for example [3] where 
expanding maps of the interval are considered. The iterative Lipschitz models 
that we study are described in Sections 2 and 3. Some background on empirical 
processes is briefly recalled in Section 4. In Sections 5 and 6, we show how 
results of [5] can be applied to get an empirical central limit theorem for the 
iterative Lipschitz models considered here. 
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2 Iterated Lipschitz maps 



Let X be a locally compact metric space, with a countable basis. Denote by d 
the metric on X. Let Tj, i > 0, be a sequence of Lipschitz maps from X to X 
and « > 0, be a sequence of Lipschitz functions from X to [0, 1] such that for 
all x £ X, J2i>aPi( x ) — 1- We will consider the Markov chain with state space 
X and transition probability P given by 

P(x,A) =J2Pi(x)U(Tix), 

i>0 

for all x € A" and all Borel subset A oi X. We also denote by P the Markov 
operator defined for measurable functions / on X by 

*7(a0= / f(y)P(x,dy) = J2Pi(x)f(Tix). 
Jx i>0 

We assume the maps T, contract on average, that is, there exists p G (0, 1) such 
that for all x,y,z £ X, 

d(T lX , T t y) Pl (z) < pd(x, y). (1) 

The case of constant P i has been studied in [7] , [2] (with applications to image 
encoding) or [8]. In particular, an empirical CLT has been proved in [13]. For 
variable pi, such systems have been considered in [6], [9] (with applications 
in learning models), [1] (existence of invariant measure) , [10] (clt), [11] (Berry- 
Essen bounds) or [12] (AISP). A lot of concrete examples, that we do not present 
in this short note, can be found in the articles cited above. 

For our general setting, we need the following extra assumptions: 

Ed(Tiy,Tiz) 
— — pi(x) < +oo. (2) 

d(Tiy,x ) 



E- 
7 



rPi(x) < +oo lor some x € X. (3) 

d(T iX ,x ) \ Pi (y) - Pi (z)\ 

sup — < +00 for some x e X. (4) 



. (| - + d{x,x ) y ,zex, y7 tz d(y,z) 

Remark that these three conditions are trivially satisfied when the family of 
maps Tj is finite. 

We will also assume that, for any x, y € X, there exist sequences of integer 
{i n )n>i an d (j n )n>i such that, for some xo € X, 

d{T ln o...oT h x,T jn o...o T h y){\ + d{T 3n o • • • o T 3l x, x )) >• 0, (5) 

n— >+oo 

with Pi n {T in _ x o- • • o^x) . . .pi x {x) > and P 3n (T jn _ 1 o • • • oT 3l y) . . .pi^x) > 
for all n > 1. Remark that this assumption is satisfied when (l)-(4) hold and 
the pi are all strictly positive. 
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3 Spaces of Lipschitz functions with weights 



We will introduce some Banach spaces, on which the operator P acts with 
good spectral properties. Let a, /3 be non-negative real numbers. We denote 
by "H QJ /3 the space of continuous functions from X to R such that ||/||a,/3 = 
N p(f) + m aAf) < +°°; where 

W) = ^p and m a ,p(f) = sup T^TX^ ^ 

1 + d(x,x )P ' H x,yex,x?yd{x,y) a {l + d{x,x a )P) 

for some fixed x n e A\ The following statement is easily verifiable. 

Lemma 1. If f,g e H a ,p with \\f\\oo = N (f) < 1 and WgW^ < 1, then 
fg e H a ,p and \\fg\\ a ,p < ||/|U,/3 + IMk/3- 

The interest of introducing these Banach spaces is the following spectral 
decomposition of the Markov operator which is due to Peigne [10]. 

Theorem 1 (Peigne [10]). Assume (l)-(5) hold. Let a, (5 e (0, 1/2) with a < /3. 
Then 

1. P operates on 'H a ,p- 

2. There exists an attractive P -invariant probability measure v which admits 
a moment of order one, i.e. for all xq G X , J x d{x,xo)v{dx) < oo. 

3. There exists a bounded operator Q with spectral radius strictly less than 1 
such that P = v + Q, with vQ = Qv = 0. 

As a first consequence, Peigne obtained a central limit theorem for the pro- 
cess (/(Wfc))fc>o, where / is any bounded Lipschitz function and (Xk)k>o is 
the Markov chain starting at a fixed point x with transitions given by P. An- 
other consequence is the almost sure invariance principle which was proved by 
Walkden [12]. As a result, the functional central limit theorem and the law of 
iterated logarithm hold. Here we address the question of a limit theorem for 
the empirical process associated to the Markov chain starting with distribution 



4 Empirical processes 

For a stationary process (Xk)k>o and a class T of measurable functions from X 
to R which are uniformly bounded, we define the empirical process (U n (f)) feF € 
by 

n—1 

The classical cases, which were studied first, correspond to the choice X = [0, 1] 
and T = {l(_oo,t] ■ t & [0, 1]}, or more generally, X = R d and T = {l(_ 00) t] : 
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t E M. d } for some d > 1. For these particular cases, results of [4] can be used 
to derive a central limit theorem for (?/„(l(_ 00 . t ])) tgR d. More recently, Dehling, 
Durieu and Tusche [5] established some results for the abstract case of .F-indexed 
empirical processes. They involve the following definition of bracketing number: 
If I, u : X — > R are two functions satisfying l(x) < u(x) for all x £ X, the bracket 
[l,u] is defined by [l,u] := {/ : X -> R : I < f < u}. Given e,A > 0,r > 1, a 
subset Q of some Banach space with norm || • ||. and a probability law fi, we call 
[I, u] an (e, A, Q, Z/(/i))-bracket if I, u € Q and 

||«-i||r<£, ||«||<A 11*11 < A 

where || • || r denotes the L r (^,)-norm. Now, for a class of measurable functions 
J 7 , the bracketing number N(e, A, J 7 , Q, L r (p)) is defined as the smallest number 
of (e, A, Q, L r (/x))-brackets needed to cover J ' . 

5 Main results 

We consider the space C = Hip of bounded Lipschitz functions, equipped with 
the norm || • \\c = \\ • ||i,o- Under an assumption on the bracketing number which 
allows to approximate functions of the class T by functions of the spaces £, we 
can derive the following empirical central limit theorem. 

Theorem 2. Assume (l)-(5) hold. Consider the Markov chain (Xk)k>o start- 
ing with the P -invariant distribution v and transition P. Let T be a class 
of functions from X to R, uniformly bounded. If there exist 7 > 1, C > 0, 
r G (1, 2), and c > such that 

/ <5 c supiV(£,exp(C£^), T,C,L r {v))d5 < 00 

Jo £><5 

then the empirical process (C/ n (/))/ 6 jr associated to (Xk)k>o converges in dis- 
tribution in the space to a tight centered Gaussian process (W(f))f e jr 
with covariances 

00 00 
Cov(W(f), W(g)) - Cov (/(*o), g(X k )) + Y, Cov(f(X k ), g(X )). (6) 

k=0 fe=l 

This theorem can be applied for several classes of functions JF . Examples 
of such classes, as indicators of balls or ellipsoids, can be found in [5]. Let us 
state the result corresponding to the classical empirical process indexed by left 
infinite rectangles in M. d . 

Theorem 3. Assume (l)-(5) hold and X = R d . Consider the Markov chain 
(Xk)k>o starting with the P -invariant distribution v and transition P. If there 
exist 7 > 1 and C > such that the distribution function F of v satisfies 

w F (5) <C\\og(S)\-\ 
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then the empirical process {U n (lr- 00i t]))tes. d converges in distribution in the 
Skorohod space D(R d ) to a tight centered Gaussian process (W(t)) teR d with 
covariances as in (6). 



6 Proofs 

Proof of Theorem 2. We will apply Theorem 1.1 of [5]. First, as a consequence 
of the spectral decomposition of Peigne's theorem, we have the central limit 
theorem for functions of C (sec [10]), i.e. for all / £ C, 

^ -E(/(*o))) ^(0,a 2 (/)), (7) 

where a 2 (f) = Var(/(X )) +2^=1 Cov(/(X ), /(**))■ Now, set s = ^ e 
(2, +oo), j3 = 1/ s and choose a < j3. From Theorem 1, we infer that there exist 
a constant C > and 9 e (0, 1) such that for all / £ H a ,^, 

\\p n f-y{f)\\ a ^<c\\f\\ a ^e n . (8) 

We will deduce a multiple mixing property for C functions. Fix a positive 
integer p. All along the proof, C always denotes a positive constant which does 
not depend on the choice of the functions /, but its value may change. Observe 
that for each / <G 'Haj3 1 

\f{x)\°v{dx) 

X 

I' ( |/(aOI V / l + d{x,x f V „ 
< / h — u ^ It, 7? Lr (l + d{x,x ))v(dx) 

- J x \i + d{x,x y ) \{i + d{x,x )y ) 

/ G U a ,p, f e L s {v) and 

11/11- < CII/lk/3- (9) 
Moreover, for each / £ C with ||/||oo < 1, we have / e W. a j3 and ||/|| a> ^ < 
3||/||£. For all i < %\ < • • • < i p in N, by Holder's inequality and (9), we have 

\Cov(f(X io )...f(X iq ),f(X iq+1 )...f(X ip ))\ 

<E(\f(X i0 )...f(X ig )\ r )r 

x E(\E(f(X iq+1 ) . . .E(/(*OI*ip-i) • • • 1*0 - E(/(X il+1 ) . . . f(X ip ))ni 

<\\f\\r\\P^-^g-Hg)\\^, (10) 

where g = fP i *+*- i «+ 1 (f...P i *- i *-if). Since for all n, P n f € U a ,p and 
||-P"/||oo < ll/lloo < 1, Lemma 1 shows that g £ W a ,p- We can apply (8) 
to get 

\\ P H+i-Hg - V (g)\\ aJi < C\\g\\ aJi e l ^- l « . (11) 



since i+^^o) j s bounded and v has a finite moment of order 1. Thus for all 
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Further, the spectral radius of P on Wa,fi is 1, thus there exist a constant C 
such that ||P"/i|| a)1 a < C||/i|| a)i g for all n and all h G rl a ,p- Again, by Lemma 1, 
there exists a constant which is independent of / such that 

\\9\\ a ,p<C\\f\\ a ,p<C\\f\\c. (12) 

Thus, by (10), (11), (12), we get 

| Cov(f(X i0 ) . . . f(X iq ), f(X lq+1 ). . . f(X lp ))\ < C||/|| r ||/|| £ ^-^. 

Then (Xk)k>o has a multiple mixing property with exponential decay on the 
space C. Applying Theorem 4 of [4], we obtain the following moment bound: 
for aU/erwithH/Hoo^l, 

E[(^(/(I,)-E(/(I fc )))) ) <cf>1/||>g 2 ^(||.f|| £ + l). (13) 

\ \fe=0 / / i=0 

Therefore, thanks to (7) and (13), Theorem 1.1 of [5] can be applied. The 
covariance structure (6) of the limit process can be derived from the expression 
of <r 2 {j) and (8). □ 

Proof of Theorem 3. By assumption there exists r € (1, 2) such that 7 > r and 
(3) holds. By Proposition 4.1 of [5], if T = {l(_ 00 , t ] : t G R d }, we have 

iV(£,exp(Ce-^), J-,£,L r (J-)) = 0( £ - dr ) 
and Theorem 2 completes the proof. □ 
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